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ABSTRACT 

A project to upgrade social studies skills of 
secondary students in a county school systes was conducted during the 
1973-74 acadesic year. Classes of students were assigned to 
experisental and control groups in grades 7-6, grades 9-10, and 
grades 11-12. In the fall 2,000 students vere adsinistered a social 
studies skills pretest. Tests of students in the ezperisental group 
were returned to teachers with instructions to use thes for 
instructional purposes while students in the control group vere not 
given any feedback. In the spring, a 1.1 students vere posttested vith 
a parallel fori of the pretest and so'^res vere cospiled. The 
inforsation analyzed does not sake a clear case for the efficacy of 
the treatsent to provide for increased social studies skills for high 
school students. The results concerning the efficiency of the use of 
tests as teaching devices on the grounds of the "feedback** principle 
are inconclusive. Skills tested at each grade are listed and copies 
of pre- and posttests for each level are included in the appendixes 
along vith the copies of the posttest Instrusents and the resulting 
scores. (luthor/KSH) 
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SOCIAL STUDIES SKILLS EVALUATION 



PROJECT 

PROCEDURES ! 

A project to upgrade social studies skills of students In 
Tazewell County schools was conducted during the 1973-74 academic 
year. The format of the project consisted of the following elements: 
(1) Classes of students were assigned to experimental and control 
groups. Three levels of students were used, I.e. grades 7-8, grades 
9-10, and grades 11-12., (2) In the fall of 1973 all students In 
both groups were administered a social studies skills pre-test. 
Skills that were tested and the grade levels to which a skill area 
was administered are listed In Illustration 1. Copies of pre and 
post tests for each level are Included In the appendices., (3) Tests 
of all students were scored and compiled In group data. Test(: of 
students In the experimental group were returned to teachers with 
Instructions to use them for Instructional purposes In any manner that 
they wished. Students In the control group were not given feedback. 
Instructions to teachers for using test results are Included In the 
appendices., (4) In the spring of 1974 all students wert^ post tested 
with a parallel form of the pre-test. Copies of th^ post test 
Instruments are Included In the appendices., (5) ^ st tests of students 
were scored aud compiled In group data. The remainder of this section 
of the report will be devoted to data tre£ ..3nt and a discussion of the 
findings of the study. 
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ILLUSTRATION 1 
SOCIAL STUDY SKILL AREAS 

FACT OR OPINION - This skill tries to distinguish the difference between 
facts and opinions or between facts and an author's interpretation of 
the facts. This skill development will contribute to a student's 
general critical ability. (Grades 7-8, 9-10, 11-12). 

TIME RELATIONSHIPS - This skill can depend heavily on recall knowledge 
and is not truly critical thinking skill as compared with determining 
fact or opinion. It has been included because the literature in the 
field of study skills has devoted some attention to what is variously 
referred to as "skill in developing a sense of chronology." (Grades 
7-8, 11-12). 

CLASSIFYING INFORMATION - This is an organizational skill necessary 
for doing higher level critical thinking skills. (Grades 9-10). 

MAP READING SKILLS - Skill in the use of latitude and longitude, scale 
of miles, direction, and map symbols are all basic skills in map reading. 
(Grades 7-8, 9-10, 11-12). 

CARTOON INTERPRETATION - This is an observational skill that involves 
certain acquired knowledge and also can involve determining bias or point 
of view. (Grades 7-8, 9-10, 11-12). 

GRAPH SKILLS - These are skills common to several disciplines. The 
ones used here are the forms commonly used in social studies materials 
and mass media presentations. (Grades 7-8, 9-10, 11-12). 

IDENTIFYING CENTRAL ISSUE AND BIAS - This is a skill often included under 
language arts. Reading ability is closely related to skill proficiency 
rn^^ in this area. (Grades 7-8, 9-10, 11-12). 



- 3 - 



VALIDITY OF SOURCES - This is one of the most important of the critical 
thinking skills. Caution is needed in testing because if no follow-up 
is done with the questions, students can mix the best answer with what 
is the right answer and in this area even the best can be unreliable or 
wrong. (Grades 7-8, 9-10, 11-12). 

DATA CONSISTENCY - Like graphs, often used in math, this skill deals with 
forms commonly used in social studies materials. (Grades 7-8). 

STATEMENT SUPPORTING GENERALIZATION - This skill involves relating 
general and specific statements to see if there is consistency in 
data or statements. (Grades 7-8). 

DRAWING INFERENCES - This skill has dangers, but like a detective, the 
student must make certain assumptions based on the available evidence. 
(Grades 9-10, 11-12). 

APPLY PRINCIPLES TO NEW SITUATIONS - Students try to determine parallel 
relationships between events. Again danger exists if this is overdone. 
(Grades 9-10, 11-12). 

RELEVANT AND IRRELEVANT FACTS - Some information is much more significance 
for answering questions than other information. This skill tests skill 
in determining significance. (Grades 9-10, 11-12). 

MAIN THEME - The selection of the major idea in a written passage. 
(Grades 9-10, 11-12). 

DELIMITATIONS ; 

Before undertaking a discussion of results an identification of the 
parameters of the study and its limitations should be made. First the 
study is basically a descriptive one. When statistical analysis using 
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significance tests were used they were confined to non-parametric 
devices* Resources allocated to analyzing the data did not permit 
treatment of Individual data* The format of data that was available 
did not allow for sophisticated statistical analysis. Analyses that 
were conducted and discussed are primarily based on rational and 
logical premises » not quantltlve ones. They will be presented as 
appropriate during the discussion. 

FINDINGS : 

Comprehensive results of both experimental and control groups for 
all levels of students are presented In tables 2, and 3. Table 1 
presents data for grades 7-8; table 2 presents data for grades 9-10; 
and table 3 presents data for grades 11-12. Information Included at 
the beginning of each table are the number of students who took the test, 
the average score attained by the group, the test standard deviation, and 
reliability estimates of the test. Refer to table 1. It summarizes the 
Information on students at the 7th and 8th grade level. 

Immediately following the above Information are Item and subtest 
(skill area) achievement levels, In percent, for students In both 
experimental and control groups. For example, the achievement level 
of 7th and 8th grade students In the experimental group on Item #1 
was 94Z - or 94Z of the students In the experimental groups got Item #1 
correct on the pre-test. Other figures for individual items may be 
Interpreted in a similar fashion for both experimental and control 
groups on pre and post tescs* 

Also, available in tables 1, 2, and 3 are achievement levels for 
skill are^s. Refer to table 1 again. The total l-*3 row shows the 
percent achievement level for the fact or opinion skill area. The 
achievement level of students in the experimental group for the fact or 
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opinion subtest of the pre- test was 94Z* Inforaatlon for other 
skill areas can be similarly Interpreted. 

Inspection of data at the beginning of tables 1, 2p and 3 suggests 
that the overall effect of the project was not successful. While 
no attempt was made to equate the pre and post tests for difficulty 
level and statistical tests of "Significance were not conducted because 
of limited data, casual observation reveals the experimental groups 
did not exhibit superiority over the control groups. Data for 11-12 
grade students demonstrates this fact most clearly. Both experimental 
and control groups scored at the 6SZ level on the pre-test and both 
scored at the 61X level on the post test. In other words, both groups 
were equal on the pre-test and, while the experimental group was 
subjected to the treatment of using test results to Improve skills. It 
did not sliow superiority on the post test. In the other two tables 
the equivalence of the groups Is not as precise as those In table 3, 
however the findings are similar. That Is, superiority for the treatment 
groups cannot be demonstrated. See table 2 for example. There was a 
5% superiority for the experimental group of 9-10 grades on the pre-test 
and a 3% superiority on the post test. Table 1 shows an 8Z superiority 
for the experimental group of 7th-8th grades on the pre-test and an IIZ 
superiority on the post test. 

It may be desirable to examine each Individual question and 
compare results on pre and post testing. In this undertaking, evidence 
of the nature of skills tested could be obtained and Inferences about 
the type of Instruction to provide students might be made so that 
weakness could be corrected. However, for purposes of this report 
It may be more desirable to examine data about the skill areas (or 
subtests) of the various tests, analyze them and make statements about 

Q the findings. 
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Table 1 

COMPREHENSIVE TEST 
STATISTICS 
Grades 7-8 





Pre- 


-Test 


Post 


Test 


No. Students-Exp. Group 
No. Students-Control Group 


702 
269 




680 
287 




Mean. Score-Exp. Group 
Mean. Score-Control Group 


26.2 
23.2 


(66Z) 
(58Z) 


26.6 
22.1 


(67%) 
(55Z) 


Std. Devlatlon-Exp. Group 
Std. Deviation-Control Group 


5.9 
6.2 




5.9 
6.1 




Reliability (KR-20)Exp. Group 
Reliability (KR-20) Control Group 


.81 
.81 




.82 
.81 





ITEM AND SUBTEST PERCENT ACHIEVPIENT 
Levels: Pre and Post Tests 
Grades 7-8 



Experimental 
Pre Post 



Control 



Pre 



Post 



Subtest I-Fact or Opinion : 

ITEM 



1 


94 


95 


88 


92 


2 


93 


93 


88 


86 


3 


94 


96 


34 


89 


Total 1-3 


94 


95 


87 


89 


Subtest II-Time Relationships: 










ITEM 










4 


83 


96 


81 


89 


5 


44 


72 


46 


74 


6 


11 


58 


29 


49 


Total 4-6 


46 


75 


52 


71 


Subtest Ill-Classifying Information: 










ITEM 










7 


40 


71 


58 


65 


8 


93 


86 


84 


77 


9 


73 


43 


72 


42 


Total 7-9 


69 


67 


71 


61 
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Experimental Control 

Pre Po8t Pre Post 

Subtest IV-Map Reading : 

ITEM 

10 58 56 46 52 

11 71 45 49 36 

12 56 56 30 46 

13 56 29 41 23 

14 46 45 38 22 

15 41 43 28 25 

16 78 89 71 82 

17 74 67 57 62 

18 81 53 61 50 

19 80 88 7? 78 

20 79 58 72 46 

21 62 86 58 70 
Total 10-21 65 60 52 49 

Subtest V-Graph Interpretation ; 



58 92 73 75 

67 86 58 72 

81 87 73 68 

69 88 68 72 




Subtest Vl-Cartoon Interpretation ; 




92 70 82 60 

77 16 69 7 

71 54 46 32 

80 47 66 33 

Subtest Vll-Identlfying Issues ; 

ITEM 

28" 72 90 64 85 

29 69 36 59 32 

30 82 44 70 29 

31 36 80 30 69 
Total 28-31 65 63 56 54 

Subtest Vlll-Vftlidlty of Sources ; 

ITEM 

32~" 80 89 71 72 

33 91 82 77 52 

34 58 37 37 38 
Total 32-34 76 69 62 54 
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Subtest IX"Data Consistency ; 

ITEM 
35 
36 
37 

Total 35-37 
Subtest X-Supportlng Statements : 




Experimental 
Pre Post 



Control 



Pre 



Post 



32 
39 
31 
34 



46 
48 
69 
54 



25 
29 
34 
29 



32 
47 
55 
45 



45 
72 
52 
56 



62 
83 
66 
70 



36 
66 
64 
55 



30 
60 
42 
44 



Table 2 

COMPREHENSIVE TEST 
STATISTICS 
Grades 9-10 





P re-Test 


Post 


Test 


No. Students-Exp. Group 
No. Students-Control Group 


234 
149 


236 
153 




Mean. Score-Exp. Group 
Mean. Score-Control Group 


28.6 (57Z) 
26.0 (52Z) 


28.0 
26.3 


(56Z) 
(53Z) 


Std. Oeviation-Exp. Group 
Std. Deviation-Control Group 


7.7 
6.9 


7.2 
6.5 




Reliability (KR-20)Exp. Group 
Reliability (KR-20) Control Group 


.85 
.81 


.83 
.80 





ITEM AND SUBTEST PERCENT ACHIEVEMENT 
Levels; Pre and Pos t Tea ts 
Grades 9 - l^T 



Experimental 
Pre Post 



Control 



Pre 



Post 
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Subtest I-Fact or Opinion ; 

ITEM 

1 
2 

^continued on naae 9) 



97 
95 



94 
94 



97 
93 



96 
93 
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Experimental 
Pre Post 



Control 



Pre 



Post 



Subtest I-Fact or Opinion : 
(continued) 

ITEM 
3 
4 
5 

Total 1-5 
Subtest _II-Dravlng Inf exences ; 



90 
85 
78 
89 



97 
92 
93 
94 



95 
87 
83 
91 



94 
93 
96 
94 




48 
39 
56 
32 
24 
40 



67 
20 
60 
49 
22 
44 



45 
34 
43 
22 
18 
34 



67 
14 
53 
55 
24 
43 



Subtest Ill-Source Validity ; 

ITEM 

11 53 

12 79 

13 93 

14 54 

15 81 
Total 11-15 72 

Sulitest IV-Appllcat^lqn^of Principles : 



89 
80 
63 
52 
83 
73 



58 

75 
91 
46 
75 
69 



90 
78 
61 
41 
88 
72 




49 
59 
53 



44 
58 
51 



44 
53 
49 



31 
46 
39 
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Subtest V-Identlfylng Bias ; 

ITEM 

18 

19 

20 

21 

Total 18-21 

Subtest VI-Graph Reading : 

ITEM 

22 

23 

24 

25 

26 

27 

(continued on page 10) 



32 
38 
48 
39 



77 
39 
70 
76 
59 
30 



58 
67 
49 
8 
46 



48 
41 
11 
90 

73 



23 
32 
41 
32 



75 
40 
62 
77 
48 
32 



73 
61 
39 
8 
45 



40 
35 
15 
88 

67 
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Experlmental 
Pre Post 



Control 



Pre 



Post 



Subtest VI-Graph Reading : 
(continued) 

ITEM 
28 
29 
30 

Total 22-30 
Subtest Vn-Car toon Interpretation: 



70 
63 
17 
56 



68 

53 
A9 
5A 



66 
55 
17 
52 



63 
55 
AC 
51 



ITQl 
31 
32 
33 

Total 31-33 
Subtest VIII-Map Readln&: 



50 
71 
71 
64 



60 
56 
Al 
52 



56 
62 
61 
60 



9A 
72 
51 
72 



) 



ITEM 

3A 

35 

36 

37 

38 

39 

AO 

Al 

A2 

A3 

AA 

A5 

A6 

A7 

A8 

Total 3A-A8 



35 
51 
55 
68 
67 
69 
45 
54 
72 
78 
75 
65 
61 
33 
53 
59 



50 
A7 
53 
51 
69 
55 
53 

AO 
70 
78 
57 
65 
35 
35 
5A 



22 
38 
38 
56 
58 
56 
32 
42 
58 
65 
60 
53 
52 
24 
40 
46 



Al 
39 
39 
A8 
67 
A7 
79 

31 
59 
78 
52 
69 
25 
3A 
51 



Subtest IX-Maln Theme: 



ITEM 

A9 

50 

Total A9-50 



44 
12 
28 



75 
39 
57 



61 
28 
45 



82 
33 
58 



Table 3 

COMPREHENSIVE TEST 
STATISTICS 
Grades 11 - 12 
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Pre- 


-Test 


Post 


Test 


No. Students-Exp. Group 
No. Students-Control Group 


188 

3 12 




165 
295 




Mean. Score-Exp. Group 
Mean. Score-Control Group 


35.8 
35.7 


(o5Z) 
(65%) 


33.4 
33.7 


(61%) 
(61%) 


Std. Devlatlon-Exp. Group 
Std. Deviation-Control Group 


7.6 
8.0 




8.0 
7.0 




Reliability (KR-20)Exp. Group 
Reliability (KR-20) Control Group 


.85 
.87 




.87 
.82 





ITEM AND SUBTEST_PERCENT ACHIEVEMENT 
Levels: Pre and Post Tests 
Grades 11 - 12 



Subtest I-Fact or Opinion : 

ITEM 



Experimental 
Pre Post 



C ontrol 
Pre Post 



1 


96 


98 


96 


94 


2 


94 


95 


96 


93 


3 


94 


98 


94 


98 


A 


90 


96 


93 


96 


5 


90 


96 


89 


97 


Total 1-5 


93 


97 


94 


96 


Subtest II-Drawing Inferences: 










ITEM 










6 


60 


78 


60 


71 


7 


3A 


i: 


34 


14 


8 


53 


79 


63 


71 


9 


38 


58 


42 


54 


10 


23 


27 


28 


27 


Total 6-10 


42 


51 


46 


47 


Subtest Ill-Valldity of Sources: 










ITEM 










11 


57 


98 


56 


92 


12 


90 


85 


87 


85 


13 


98 


75 


93 


67 


lA 


71 


56 


60 


50 


15 


89 


92 


91 


91 


Total 11-15 


81 


81 


77 


77 



o 
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Experimental 



Control 



Pre 



Post 



Pre 



Post 



Subtest IV-Applylng Principles : 

ITEM 

16 

17 

Total 16-17 



70 
69 
70 



46 
73 
60 



74 
77 
76 



48 

64 
56 



Subtest V-Identlfylng Bias ; 




41 
54 
69 
53 



69 
72 
54 
8 
51 



42 
50 
73 
55 



66 
74 
52 
12 
51 



Subtest VI-Graph Reading ; 

ITEM 

22 

23 

24 

25 

26 

27 

28 

29 

30 

Total 22-30 

Subtest Vll-Cartoon Interpretation : 

ITEM 
31 
32 
33 

Total 31-33 



86 
46 
60 
94 
74 
36 
87 
74 
10 
63 



68 
83 
74 
75 



78 
68 
18 
92 

82 
72 
62 
64 
67 



36 
67 
67 
57 



87 
44 
65 
93 
71 
31 
88 
72 
10 
62 



71 
78 
76 
75 



53 
48 
15 
94 

78 
78 
70 
65 
63 



67 
77 
44 
63 



Subtest VIII-Map Reading ; 

ITEM 

34 

35 

36 

37 

38 

39 

40 

41 

42 



49 
62 
62 
85 
81 
79 
48 
69 
78 



67 
67 
47 
56 
72 
59 
58 

42 



44 
52 
63 
79 
82 
82 
35 
64 
82 



55 
56 
39 
59 
79 
57 
68 

44 
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Experimental Contxol 
Pre Post Pre Post 



Subtest VIII-Map Reading ! 
(continued) 

ITEM 





43 


88 


72 


87 


81 




44 


86 


84 


84 


89 




45 


75 


53 


80 


67 




46 


72 


67 


73 


84 




47 


40 


42 


40 


36 




48 


60 


47 


71 


46 




Total 34-48 


69 


60 


68 


61 




Subtest IX-Maln Theme: 












ITEM 












49 


15 


29 


28 


34 




Subtest X-Relevant Facts: 












ITEM 












50 


88 


65 


88 


71 




51 


55 


50 


49 


52 




52 


61 


82 


JO 


OA 




Total 50-52 


68 


66 


65 


68 




Subtest XI-IdentlfylnK Time Relationships: 










ITEM 












53 


18 


18 


15 


17 




54 


64 


67 


54 


66 




55 


71 


83 


72 


80 




Total 53-55 


51 


56 


47 


54 






Table 4 










PRE AND 


POST TEST ACHIEVEMENT 


LEVEL 








COMPARATIVE 


DATA FOR EXPERIMENTAL 


& CONTROL 






GROUPS IN GRADES 7-8 










SKILL AREA 


PRE-TEST ACHIEVEMENT 


POST TEST 


ACHIEVEMENI 






Level (X) 




Level (%) 






Ex^. Control 




Exp. 


Control 


1. 


Fact or Opinion 


94 87 




95 


89 


2. 


Time Relationships 


46 52 




75 


71 


3. 


Classifying Information 


69 71 




67 


61 


4. 


Map Reading 


65 52 




60 


49 


5. 


Graph Interpretation 


69 68 




88 


72 


6. 


Cartoon Interpretation 


80 66 




47 


33 


7. 


Identifying Issues 


65 56 




63 


54 


8. 


Validity of Sources 


76 62 




69 


54 


9. 


Data Consistency 


34 29 




54 


45 


10. 


Supporting Statements 


56 55 




70 


44 
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Table 5 

PRE AND POST TEST ACHIEVEMENT L EVEL 
COMPARATIVE DATA FOR EXPERIMENTAL & CONTROL 
GROUPS IN GRADES 9-10 



SKILL AREA PRE-TEST ACHIEVEMENT POST TEST ACHIEVEMENT 

Level (%) Level (%) 







Exp. 


Control 




Control 


1. 


Fact or Opinion 


89 


91 


94 


95 


2. 


Drawing Inferences 


40 


34 


44 


43 


3. 


Source Validity 


72 


69 


73 


72 


4. 


Application of Principles 


53 


49 


51 


39 


5. 


Identifying Bias 


39 


32 


46 


45 


6. 


Graph Reading 


56 


52 


54 


51 


7. 


Cartoon Interpretation 


64 


60 


52 


72 


8. 


Map Reading 


59 


46 


54 


51 


9. 


Main Theme 


28 


45 


57 


58 








Table 6 








PRE AND 


POST 


TEST ACHIEVEMENT LEVEL 






COMPARATIVE 


DATA 


FOR EXPERIMENTAL & 


CONTROL 






GROUPS 


IN GRADES 11 - 12 







SKILL AREA PRE-TEST ACHIEVEMENT POST TEST ACHIEVEMENT 

Level (%) Level^X) 







Exp. 


Coiitrol 


Exf . 


Control 


1. 


Fact or Opinion 


93 


94 


97 


96 


2. 


Drawing Inferences 


42 


46 


51 


47 


3. 


Validity of Sources 


81 


77 


81 


77 


4. 


Applying Principles 


70 


76 


60 


56 


5. 


Identifying Bias 


53 


55 


51 


51 


6. 


Graph Reading 


63 


62 


67 


63 


7. 


Cartoon Interpretation 


75 


75 


57 


63 


8. 


Map Reading 


69 


68 


60 


61 


9. 


Main Theme 


15 


28 


29 


34 


10. 


Relevant Facts 


68 


65 


66 


68 


11. 


Identifying Time Relationships 51 


47 


56 


54 



Tables 4, 5, and 6 summarize the results of pre and post testings foi* 
both experimental and control groups for skill areas. See table 4, 
for example. The achievement level of 7th and 8th grade suudents in 
the experimental group on the fac t or opinion skill area of the pre-test 
was 9U%i it was 87% for the control group on the pre-test ; 95% for the 
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experimental group on the post test and 89% for the control group 
on the post test. Other Information relative to other skill areas 
In the table can be interpreted in a similar fashion — and likewise 
for tables 5 and 6 which present data for 9th-10th grades and 11th- 
12th grades respectively. 

The establishment of criteria to Judge the efficacy of the treat- 
ment used In this study was a subjective matter. Many competency based 
educators suggest the 80Z achievement level as evidence of a successful 
program. Accordingly, the achievement of 80% proficiency In a skill 
area was used as evidence of treatment success. For the experimental 
groups at all levels (7-8, 9-10, 11-12) the 80% level of proficiency 
was attained in 5 of a possible 30 skill areas. These were: 

Fact and Opinion - 7-8, 9-10, 11-12. 
Graph Interpretation - 7-8. 
Validity of Sources - 11-12. 

For the control groups the 80% proficiency level was attained In 3 of 

30 cases • 

Certainly the above data cannot be construed as evidence ot 
superiority for the treatment group, especially since the 80% level was 
attained on the pre-test by both experimental and control groups In the 
fact or opinion skill open at all three levels. I.e. 7-8, 9-10, 11-12. 
What this means is that the 80% level was achieved In only two skill 
areas of the remaining 27 by experimental groups. The ^^luster** of the 
above performance Is dulled by the fact that students In the 7th and 
8th grades experimental group regressed from the 80% level on the pre- 
test, cartoon Interpretation subtests > to 47% on the post test. In 
effect, the experimental group had a net advantage of one skill for all 
grade levels. 
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Another analysis which may reveal the efficacy of the treatment 
on the experimental group is a determination of the number of skill areas 
where the Increase or decrease on the post test, as measured by percent 
of achievement gain or loss when compared to the pre--test, was at 
least 5%.* Refer to tables 4, 5, and 6. A 5% gain by the 7-8 grade 
experimental group between pre and post testings was shown In four skill areas: 

1. Time Relationships. 

2. Graph Interpretation. 

3. Data Consistency. 

4. Supporting Statements. 

This data can be compared to the 7-8 grade control groups data 
which Indicated 5% gains In two areas: 

1. Time Relationships. 

2. Data Consistency. 

When viewed on the basis of the 5% criteria the experimental group 
demonstrated a slight advantage. If we couple this fact with the 
additional one that the experimental group for 7-8 grade students 
declined by 5% points In fewer categories than the control group, 
evidence In favor of the treatment Is somewhat better. Refer to table 4. 
The experimental group declined by 5% points In three areas. I.e. 
map reading, cartoon Interpretation, and validity of sources compared 
to four areas of decline by the control group. I.e. classifying Informa- 
tion, cartoon Interpretation, validity of sources, and supporting 
statements. In summary, using the 5% gain/loss criterion the evidence 
weighs slightly In favor of the treatment group for 7-8 grades. 

When grades 9-10 experimental and control groups are compared on 
the 5% criterion, the trend shifts In favot of the control group. 
Refer to table 5. Increases of 5% for the experimental group number 
three I.e. fact or opinion. Identifying bias, and main theme. For 
the control group Increases are shown In five areas I.e. drawing 

O *5Z Is an arbitrary figure which the evaluator used as a meaningful 

ERJC change between testings. 
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Inferences; Identifying blas^ cartoon interpretation, map reading, and 
main theme. Thus the control group had a 5 to 3 advantage over the 
experimental group. This advantage prevailed when 5% losses were 
compared* The experimental group lost In two skill areas, cartoon 
interpretation and map reading; the control group lost 5% in one area, 
application of principles. 

Data for the 11-12 grade students is generally inconclusive. Gains 
of 5% were made in three areas by the experimental group and In two 
areas by the control group. Losses of 5% were made in three areas in 
both groups. Refer to table 6 for identification of specific groups. 
In summary no statement can be made regarding superiority of either 
experimental or control groups on the basis of findings for 11th and 
12th grade students. 

Resources did not permit sophisticated statistical inquiry into 
whether significant differences existed between the control and experi- 
mental groups. However, inquiry was made into which group gained the 
greatest number of percentage points (or lost tl'e fewest points) between 
pre and post testings for the skill areas included in the various grade 
levels. Chi square tests of significance were conducted to sae if 
statistically significant results existed. For 7-8 grade iitudents the 
experimental group showed superiority in points gained or lost between 
pre and post testings in six skill areas and the control group gained 
more points in four skill areas • (There was a tie in one area). 
Refer to table 4. For 9-10 grade students the experimental group showed 
superiority in three areas and the control group in six areas. For 
11-12 grade students the results were six in favor of the experimental 
group, two for the controls, and two ties. See tables 5 and 6. Chi square 
tests for each case were not significant and there Is no basis from this 

^ evidence to support superiority for the treatment. 

ERIC 
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CONCLUSIONS: 

On the basis of information analyzed It is difficult to make a 
case for the efficacy of the treatment to provide for increased 
social studies skills for high school students. While experts In 
educational measurement espouse tie use of tests as teaching devices 
on the grounds of the ^^feedback" principle, results concerning their 
efficiency has been inconclusive. In two prior research studies by 
one of the authors of this report the use of quizzes as teaching aids 
have not proved effective (1, 2). Speculation as to the reasons for 
the lack of efficacy of tests va?.y. It may be that for certain 
types of skills, mere information concerning performance is insufficient, 
of itself, to effect change. What probably needs to be done in addition 
to feedback is establishment of an educational program to upgrade 
skills iu areas of deficiency. 

It is not the intent of the evaluator to condemn the project 
for its failure to effect positive results among students in the 
treatment group. Most certainly a major finding of the study which is 
of considerable value is the information concerning achievement levels 
of students in the various skill areas. On post test results for 
both experimental and control groups the desired 80% level of achievement 
was attained in only 8 of a possible 60 instances. This fact alone 
describes the deficiency of students and, presuming the skills are of 
a type valued by the Tazewell County School System, ;>oints out the 
necessity of developing instructional modes which foster such skills. 

Another encouraging note in the project was the development of 
skills tests which purport to measure social study skills of students 
at the secondary level. The efforts on this behalf need refinement and 
the continued cooperation between county personnel and test developers 

^ is encouraged. 

ERIC 
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